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ABSTRACT 

This thesis considers two problems: a) the design of an optimal 

dynamic compensator for a multivariable discrete time system and b) the 
design of compensators to achieve minimum variance control strategies 
for single input single output systems . Both problems are stochastic in 
nature* 

In the first problem the initial conditions of the plant are random 
variables with known first and second order moments, and the cost is the 
expected value of the standard cost, quadratic in the states and controls* 
The compensator is based on the minimum order Luehberger observer and it 
is found optimally by minimising a performance index. Necessary and 
sufficient conditions for optimality of the compensator are derived,, The 
compensator is given in Auto Regressive Moving Average form. 

The second problem is solved in three different ways; two of them 
working directly in the frequency domain and one working in the time 
domain (state space techniques). It turns out that the first and second 
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order moments of the initial conditions are irrelevant to the solution. 
Necessary and sufficient conditions are derived for the compensator to 
minimise the variance of the output. 


Thesis supervisor: 


Title*. 


Timothy L. Johnson 
Associate Professor of Electrical Engineering 


ACKNOWliEDGEMENT s 


It is almost impossible to thank all the people that have contributed 

in one wav or another , to make this moment come true* However, X would 

like to express my thanks to Professor Timothy L. Johnson, who, not only 

had the immense task of being my advisor but supervised this thesis from 
1 

beginning to end* 

To Nancy Young for her terrific job and velocity typing this thesis. 
To Cheryl Worden for her previous typings and her patience correct- 
ing the errors in English - 

To the Trachtenberg family, Ernesto Pataky and Carlos A. Pullin for 
their encouragement and advice in all aspects of life. 

To the Organisation of American States for their financial aid, 
without which, this moment would not have occurred. 

And to my parents, Abraham and Pina Mainemer for their help, 
reprimandals and guidance that showed me the way to become what I have 
become. 


-5- 


TABLE OP CONTENTS 

Page 

ABSTRACT 2 

ACKNOTvEEDGEMENTS 4 

TABLE OP CONTENTS 4 5 

CHAPTER I 1 

1. Brief Historical Review 7 

2 . Outline of Contents ® 

3. Notation and Terminology 3.0 

CHAPTER II H 

1. Introduction 3.1 

2. Structure of Multivariable Systems 3.2 

3. Minimal State Space Representation for Linear 

Multivariable Systems 16 

4. Classical Adjoint of a Matrix 25 

CHAPTER III 29 

1. Introduction 29 

2. The Discrete Time Linear Regulator Problem 33. 

3. Structure of the Discrete Time Minimum Order 

Based Compensator 33 

4. The Minimum Order Observer Based Compensator 41 

Problem. 


5. 

The A-R,M*A. Compensator 

56 

Chapter 

XV 

68 

1. 

Introduction 

68 

2* 

Minimum Variance Control - Direct Method 1 

63. 

3. 

Minimum Variance Control - Matrix Approach 

74 

4- 

Minimum Variance Control of an Output Noise-Free 
System - Direct Method 2 (Astrom T s Approach) 

85 

Chapter 

V 

83 

1 . 

Solution Using Direct Method 2 

89 

2. 

Checking the Result Using the Matrix 
Approach 

83 

REFERENCES 

9.4 


CHAPTER I 


Ip BRIEF. HISTORICAL REVIEW 

The problem of finding compensators for systems in state space form 
has been widely studied. It is a known fact that if the pole configura- 
tion of a controllable plant is not desirable, it can be arbitrarily 
changed using state feedback. A rigorous formulation of the linear state 
regulator problem is also known. 

At first, the linear quadratic problem was formulated as a com- 
pletely deterministic one, penalizing both deviations from the desired 
plant state and excessive use of control. The solution, as it is well 
known, is in the form of a complete state feedback control law- This 
formulation constitutes an idealization, since most of the time the 
initial state is not exactly known and complete state measurements are 
not available. For these reasons, the problem was reformulated as a 
stochastic one where the first and second order statistics of the initial 
state and the noise were known. The cost was taken as the ensemble 
average value of the deterministic performance index. Surprisingly 
enough, the new result was a Kalman filter followed by the same gains 
obtained in the deterministic framework. In this thesis* we will work 
out this problem assuming that no plant or measurement noise is disturb- 
ing the system. The solution obtained is a minimum order observer as 
proposed by Luenberger (Ll) preceded by the gains found in the previous 
two formulations. Since the parameters of the Luenberger observer are 


•L 




A 


- 8 - 


rather arbitrary , several authors , among them Blanvillain (Bl) , Miller 
(Ml) and Llorens (L2 ) , have determined the compensator parameters by 
minimising a performance index , which gives a specific form for the 
observer r A surprising characteristic in the solution of this problem 
is that a separation develops in the equations for the parameters of the 
observer and the optimal gains, the latter being the same as if complete 
state measurements were available. It turns out that the minimum-order 
observer-based compensator is optimal - 

All the preceding methods have been worked out for state space re- 
presentation of a system. Astrom (Al) , following another line of work, 
finds minimal output variance control strategies directly using an Auto- 
Regressive Moving-Average model for single-input single-output plants. 

In this approach, although he doesn T t have the freedom of the state space 
techniques (he is just minimising the variance of the output and no 
penalties are assigned to the states nor to the input) , Astrom has the 
great advantage that the gains are very , easy to compute by simple poly- 
nomial division. 

2. OUTLINE OF CONTENTS 

Chapter two is designed to be a background chapter;' this means 
that the techniques needed to go from an Auto-Regressive Moving-Average 
(A.R.M.A. } model to a minimal state space representation of a, system, 
and vice versa, are developed- The importance of the fact that the first 
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transformation is to a minimal stats space form lies in the conditions 
required for positive definiteness of certain 

covariance matrices, as pointed out by Llorens (L2) . This technique 
requires the &.R.I4.A. model to have a specific structure which can be 
achieved by matrix multiplications. The transformation form state space 
to an A.R.M.A. model involves the computation of the classical adjoint 
of a matrix, which is shown in section 4. 

In chapter three the structure of the discrete time minimum order 
observer as well as the linear regulator problem axe presented as back- 
ground for the main problem, the solution of the discrete time minimum 
order observer based compensator. It is assumed that the initial state 
plant is a random vector with known first and second order statistics. 
The performance index is the expectation of the standard cost over the 
time interval [Q,») , quadratic in the state and control vectors. The 
approach mimics Blanvillain 1 s work until the actual minimisation point, 
where the technique used by Llorens (L2) is employed. 

Chapter four deal with the problem of finding the minimal variance 
control strategy for a single-input single-output discrete time system* 
Direct method 1 gives the necessary conditions to solve the problem, but 
even for a simple example they are very difficult to solve. The matrix 
approach solves this problem completely using state space techniques, 
while direct method 2 gives the solution to the problem in a very simple 
way (a polynomial division) but has the disadvantage that it assumes the 
observations to be noise-free. For all the above methods, a certain 
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structure for the compensator was assumed r and this is that the input at 
time t cannot depend on the output at the same time t, which makes a lot 
of sense in a discrete time system because it is not usually possible to 
feed the output instantaneously back to the input in such a system- 
In chapter five a second order example is solved, first using 
direct method 2, and then the answer is checked by inserting it into the 
equations given by the matrix approach. 

3. NOTATION AND TERMINOLOGY 

Small boldface Roman letters will denote vectors and capital letters 
will denote matrices unless otherwise stated- A* denotes the transpose 
of A, adjA the classical adjoint of A; I the identity matrix and 0 the 
zero matrix. A(mxm) denotes the matrix A which is of dimension mxm. It 
is stressed that same matrices in different chapters have different mean- 
ings. P(z) denotes a matrix v/hich is a function of z except in chapter 
four where it is used as a (scalar) polynomial function of z. 

The expected value (ensemble average) is denoted by e{*}. The co- 
variance matrix of a vector valued random variable: 

Etxftjx 1 (t) ) - E(x(t) )E(x' (t) ) 

is denoted by: 

cov{x (t) ) 

Also / the numeration of the equations are independent from section to 
section. 
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. . CH&PTBR XI 

1. INTRODUCTION 

The problem of finding optimal compensators for systems described 
in state space form has been widely studied , but this approach assumes 
that we already have the matrices that describe the system in such a form. 
This assumption is somewhat ideal/ since in order to describe a plant in 
a mathematical model we have to derive the equations that govern it from 
basic principles. In this event the model of the system will be given 
to us in the form of differential equations, for continuous time systems , 
or difference equations for discrete time systems* In order to design a 
compensator for such a system/ we have to choose one of two possible 
approaches : either convert the system into a state, space representation 

or use the input output description* In chapter four we are going to use 
both techniques to find the minimal variance control for a plant, while 
in chapter three we use only the latter one* 

The intention of this chapter is to serve as a background for the 
work in chapter three* So, we will show the techniques available to con- 
vert a system from an A*R-M-A* model to a state space representation, 
and vice versa. 

The structure of this chapter is as follows- In the second section 
the structure of multivariable systems is presented as a background to 
the work in section three T where the steps to find a minimal state space 
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representation for a multivariable system are developed. Both these 
sections rely on the work of Wolovich (Wl) and Wolovich and Falb (W2). 
Section four deals with the transformation back from the state space form 
to an A.R.M.A. model, where the main problem is the calculation of the 
adjoint of a matrix. This section is based on Gantmacher’s book [Gl] . 

2. STRUCTURE OF MULTIVARIABLE SYSTEMS 
Let's consider systems of the form 

x(t+l) = A Xlt) -r B U{t) (1) 

y(t) = c x(t) 

where 

x(t) is an n vector 
u(t) is p vector 
y(t) an m vector 

and A,B,C are constant matrices of appropriate dimensions. 

Furthermore, let's assume that B and c are matrices of full rank. 
Then, it is a well known fact that if the pair (A,C) is completely 
observable, there exists a similarity transformation g such that the 
system 

z(t+l) = S. z(t) + § u(t) (2) 

y(t) =* £ z(t) 

where £ = -O^AQ £ = Q^B £ = eg 


is in standard observable form. 
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We are going to show now, how to obtain the matrix 0. 

o n^l 

Let K = [C 1 , -A'C' , A' C',...(-A' ) C 1 ], then, since we assumed 

that system (1) was completely observable, the n x nm matrix k is of 
rank n, and it is possible to define a basis for consisting of the 
first n linearly independent columns of K. Let L be a matrix whose 


columns are the basis for R in the following order 

n 0,-1 cr„-l 


= [q,-A'Cj_,...,{-A*) 1 C^, 2 C’,.-.,C-A’) m "V] 


c - I -V 


Setting d^ = £ 

i-1 


k 1 ,2 f ,m 


where d Q — 0 

th “T 

and ■ letting be the row of L we define the matrix O as 


O = 131 {-A)u‘ .. .(-A) " J',.-., (-A) an 

i JL i m 


After doing the transformation pointed out in (2) we get A as a 
block matrix of the form 


A = 


*11 **• 

A. 

lia 

A 

w 

*21 *** 

£ 

CM 

A 

/N 

A _ ** * 

ml 

A 

mm 


I 
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with A. ^ a cs\ x ci companion matrix given by 


13. 


0 0 
1 0 
0 1 

0 0 
0 0 


0 

0 

0 

1 

0 


*i-l + 1 ' d i 
^i -1 * 2 ' d i 


Ad. 


.. .. + 3, d. 

i-l ' a 


Ad. d. 

i-l i 

A 

Ad., d. 

i i 


and a. . a . x . matrix 
13 i 3 


a. . = 

13 


0 0 .. M. . + 1 , d. 

1-1 3 

A 

0 0 .. Ad. , 4- 2, d. 

i-l 3 


00 .. Ad.d. 

1 3 


for i ^ 3 . And C is an m x n matrix of the form 


C = 


0 ... 

0 ... 

0 ... 

0 ... 


0. . . 


C^/d^ 0* • 

C 3' d l °" 

A 

C ,d 0. . 
m 1 


0 

1 


■ °3' d 2- 

A 

* c '<V 

in 2 


0 

0 

0 

1 


Now, that we have obtained the structure of the system after the 
transformations were made:,, we are going to compute the transfer matrix of 
the plant, T(s) 


l!(s) = C (zT-Zi) 


- 1 


B 


. A A 
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But by taking advantage of the structure of the system, we can find 
T (z) as 

A A 

2_.Cz) « C Q A _x (s)s (z)b q 


where 


S (s) = 


1 s 


0 0 


0 0 


V 1 n 

2 0 


V 1 


cr - i 

m 


c o = 


C 2' d X 

V d i 


c ,d 

HI X 


0 

1 


C ,d 
3 2 


c ,a 

m 2 


0 

0 


B 0 = B 

A 

and A(z) is the m x m matrix with entries given by A, , (z) = det(sX .) 

XI 0 "' 

A A U* - A ' 

and A., (a) = -Ad. +l,dj - zAd, -f 2,dj - ... -z 1 Ad.,d. for i 
x3 x-i x-1 x j 

Note that A(z) can be rewritten as 


A (a) = 


V 

z 

0 

0 

... 0 

0 

0 2 

z 

o 

... 0 

0 

0 

ff 3 

z 

... 0 

o ; 

0 

0 

m 

... z 


- S (z)&_ 




vt % 
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v/here A is an n x m matrix of the coefficients of a. . i,j = l,2,...ra 
u 13 

given by 


A S' A 

! i f f 


■Vi 

V d 2 

A l (d m 

A 

A 

A 

* 

K 

CM 

A 2 ,d 2 

Arj /d_ 

2 HI 

• 

# 

A 


a 

Aa r a i 

Ad^ r d 0 ... 

Aa i' d » 

A 

A 

A 

Ad^^d 

Ad 1 +l,d 2 

Ad -rl,d 
1 m 

A 


A 

Ad 2' d l 

Ad 2 rd 2 

Ad 2' d m 

A 

A 

A 

Ad . i,a 

: m-I — 1 

Ad ^l,a_ 
m-1 2 

Ad -fl,d 
m-1 m 


A, 

A 

Ad ,d 

Ira I 

L 

Ad,d 

m2 

Ad ,d 
m m 


3. MINIMAL state space representation for linear moltxvariable systems 
I n. tills section, we present an algorithm, based on Wolovich's paper 
(Wl) , that gives a minimal state space representation for a system ex- 
pressed in a more general matrix difference ope rato r form. This -trans- 
formation is very important in practice, since as the result of applying 
well known physical laws, such as Kirchoff's lavis for electrical networks 
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or Lagrange equations for mechanical systems, we obtain mathematical 
models for plants in the form of differential or difference equations 
and not in state space form. The advantage of having a state space 
representation, lies in the fact that there exist, at the present, very 
powerful techniques for designing and analyzing plants that are described , 
in such a form. These are not available when working directly with the 
equations that govern the system - 

After the algorithm is developed, a simple example will be presented 
to show how it works * 

We will work with systems that are not as general as the ones 
considered by Wolovich (¥71)/ namely, systems that are described by the 
matrix difference equations t - 

?(z)w(t) = 0(s)w(t) (1) 

y (t) = Rw(t) (2) 

where P(z) is a m x m matrix 
0(z) is m x p matrix 

R an m x m constant nonsingular matrix 
and s a difference or delay operator. 

Furthermore, we assume that Viz) is nonsingular, in order for the above 
equations to represent the transfer matrix of a system, that the system 
is strictly proper and that it is irreducible, that is, that the composite 
matrix [P(z), Q(z}] has rank m for every z £ C, as defined by Rosenbrock 
(Ri) and Popov (Pi) . This irreducibility assumption will guarantee that 
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the system in state space form will be minimal- The definition of row 
proper form will also ve required. 

DEFINITION (Row proper) : 


Let 


z 

11 


P 12 Z + - 


... P 3 +. 

1m 


PCs) = 


„ d 2 
? 21 Z + - 


d 2 

P 22 Z 


* * • ^ ^ 
2m 


P z m t, 
ml 


a 

P _Z m +. 
m2 


~ m 

- - , P z *K 
mm 


where the +-** denotes lower degree terms in each row of P(z), and is 

th 

the degree of the highest-order term of the i row- Then P (z) is said 
to be row proper if and only if detCD is not equal to zero where 



P 

11 

P 12 ”• 

P 

”lm 

F = 

P 

21 

*• 

P 22 *** 

P 2m 


■# 

p 

- "'nil 

P m2 *” 

P 

mm J 


ALGORITHM 

Step Is * 

If P(z) is row proper r this step can be omitted. If P(z) is not row 
proper / we preimiltiply (1) by any unimodular matrix U(z) which reduces 
P(z) to row proper form- An algorithm for finding such a U(s) is 
given by Wolovich (Wl) in the appendix of his paper. So (1) and {2} 
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reduce to 

U (z)P (z)'w(t) - U(z)Q(z)u(t) 

y (n) = R w(t) 

which is equivalent to the system described by {1} and (2) . 


<3) 

(4) 


Step 2t 
Let 

w Q (t) = r w(t) 


where T is the m x m nonsingular constant real matrix consisting of 
the highest degree z terms in each row of U(z)P(z). If T = I this 
step can be omitted, if not, we substitute P (t) for w{t) in (3) 
and (4) to obtain 


Pq( z ) w Q {t) = 0 Q (z) u(t) 

y(t) = R q w 0 (t) 


(5) 

( 6 ) 


where Pq(z) = U(z)P(z)T 
Q 0 (z) - U(z)Q(z) 


-1 


= RT 


-1 


We can show now, that the matrix P^(s) is in a particularly useful 


form; i.e., 


r d l 
s +. 


P Q {z) - 


^ m , 

Z -r. . - 
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! 


where the . . . denotes polynomials of lower degree than dj_ in each 

/i 

(k ) row* 

Since we assumed that the system was strictly proper, we can omit 
Wolovich's third step. Note that the intention of the previous two steps 
is to be able to identify the matrices P q (e) and 0 Q (z) with the A{s) and 
S(e)Bq found in section two. Once we have determined P Q (z) and Q q (e) , 
we can obtain a minimal realisation (A^, B^, C^) directly by observing 
their structure. 

Step 3: 

Let us rewrite P Q (s) as 



where we have replaced d_. by cr^ , so that the similarity between the 
structures of A (a) and P^ (z) be more striking. 

Let S (z) he the m x m matrix defined in section two and an m x m 
constant real matrix. 

Since the system is strictly proper, we can write Q^(z) as 

Q q (e) = S(z)B 0 (7) 


where 3^ is an n x p constant real matrix. 

We observe that the only term left -unspecified in order for 
T(z) Pq 1 (z)Q 0 

to be equal to 


-1 


T(z) « C Q A _ '{z)S(z)B 0 


^ “ 1 ^ 

is But since (z)Oq ^l^eady equal to A(s)S(s)B^ we let 

/s 

C_ = I . 

0 m • 

So, we can now obtain directly a minimal realization for the system 


P q ( 3) w 0 (t) = g Q (z) U(t) 


(5) 


as follows. 
Define 


r ' = l C. for k = 1,2,..., m 

■ i=l - 

Replace the m—r^^ columns of the (n x n) matrix 


( 8 ) 


th 


m-1 


0 J 


by the m ordered columns of to obtain b' as given by (7) is 

an appropriate B Q corresponding to the choice of A Q . Finally r let 

— th 

be the matrix obtained by substituting the m-r^ " columns of the 

A 

m x n zero matrix by the m ordered columns of Ch i.e., I .. 

u m 
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Thus far, we have obtained the following state space representation 
X Q (t*l) = A q X Q (t} + B 0 U(t) 

w 0 (t) = ? o x o (t) 

Step 4s 

Since we want to observe the output y(t) and not w (t) , we can use 
equation (6) to obtain: 
x 0 (t+l) - A q x Q {t) + B Q u(t) 

y(t) = R 0 C 0 x 0 (t) 

So, finally we have the desired minimal realisation 


x(t-KL) = a :<(t) *r B u(t) 
y (t) = C x{t) 

where 



\ 





then 

n{a)p(z) 



3z .+ 



5s + 8 


2s + 3 


U(a)0<z) 
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4. CLASSICAL ADJOINT OF A MATRIX 

This last section of this chapter deals with the problem of finding 
the (classical) adjoint of a matrix. As will be seen in the next chapter, 
this is the last step needed to convert the system given in a state space 
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form into a matrix difference operator form. The method to be used is 
the one suggested by Paddeev (PI) for the simultaneous determination of 
the scalar coefficients of the characteristic polynomial of a matrix A, 
and the matrix coefficients of the classical adjoint matrix M(z) . 

Let A be an n x n constant matrix, so, it is well known that 


-1 _ adj (zI-A) = M(z) 

12 &} ~ det (zI-A) p(z) 

where 

M(z) = adj (zX-A) 

_ , , m m-1 m— 2 

and p(z) = det (zI-A) = z - p^z - p 2 z 



As shown in Gantmacher's book (Gl) , the difference p(s) - p(u) is divisible 

by z- , without remainder. Therefore 

, . p(z)-p(u) m-1 . . . m-2 , , 2 . m-3 , 

g(z,u) - =z t (u-p^z + (■u-b 1 h-p 2 )z + ... 

( 1 ) 


is a polynomial in z and u. 

The identity 

p(s) - p(u) = g(z,u) (z-u) 

will still hold if we replace z and u by the matrices si and A respective- 
ly, giving 

p(zl) - p(A) = g(zI,A) (zI-A) (2) 


but, since by the Cayley-Hamilton theorem p(A) = 0, we get 
p (zl) = g (zI,A) (zI-A) 



A 


*1 _JL 


-ft. 
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therefore 

(zl-a)" 1 = (p(zl))" 1 g(aI,A) = (4) 

so 

g(zI,A) = U(z) (5) 

Hence, by virtue of (1) and (5) 

M(s) — lz m ^ t M 2 $ m ^ t M s m ^ . . * *f M - . (6) 

.1 2 m-1 

where 

^ = a - p^i m 2 = a 2 - p^A - p 2 i . - . 
and in general 

= a k - p x A k 1 - P 2 a k 2 - ... ~ P k l k = 1,2,..., m-1 

So , it can be easily seen that the matrices M_ , . can he com- 

1 z m-l 

puted using the recursive equation 

\ = AM k _ 1 - P fc I k = 1,2,..., m-1 (7) 

where 

M o = 1 

The coefficients of the characteristic polynomial p(s) can be easily 

found successively as . . 

kp, - S. - p.S. p- -S. k = 1,2, • » . ,n (8) 

“k k 1 k-1 k-1 1 

where 

S k - tr(A k } 
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Faddeev (Fi) combining (7) and (8) obtained the coefficients T 

p and the matrices M , M successively as follows: 

n >l a n™ -i- 


A_ =* A 




a 3 - am 2 


P 1 = trC V 

P 2 = 2 tr ^ A 2^ 


P 3 = 3 


M 1 

“ A 1 

~ P l~ 


= K 

- p„I 

2 

2 

“2 

*3 

= & 3 

- P 3 x 


A _ = AM _ 

n-1 n-2 


— T tr (A ) M 
n— 1 n— 1 n— X 


A . - p ' I 
n-1 n"l 


A = AM , 
n n-1 


p = — tr (A } 

n irt- n 


In order to check the computations, we can go one step further and find 


whether M = A - p jl equals zero or not. If M =0 the comoutations 
n n n 

are right, and if id ^ 0 there is a mistake somewhere. 

n 

The formulas in (9) are the ones that will be used in the next 
chapter to find the adjoint of the matrix (si— F). 
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CHAPTER III 

1 . INTRODUCTION 

This chapter will deal with the problem of finding a minimum order 
based compensator for a discrete time system. 

The problem of designing optimal compensators can be tackled in two 
completely different ways: (1) it can be worked out directly in the* 

frequency domain or (2) the system can be transformed from the frequency 
domain equations into state space form, and then the compensator structure 
can be found easily using the powerful techniques available- Graphically, 
this means: 


1 


3?(z), 

Q(z) -t 

R(z) 

7 s(z) 

2 (a) 

4- 

+ 

2(c) 

(A,B,C) 

(f;c- 

,D,P) 


2(b) 


There are advantages and disadvantages for working with either method; 
many of them arise from practical considerations — for example, solving 
the problem directly in the frequency domain has the great advantage 
that most specifications are given in terms of rise time', overshoot,., 
bandwidth, etc., which can be handled easier using techniques such as 
Nyquist plots. Inverse Hyquist plots, Root Locus, and Bode plots. Another 
advantage of the frequency domain method is a very practical one; engi- 
neers, in the great majority, identify very easily with such terminology. 
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The big disadvantage that this method faces, is the lack of powerful , 
easy to implement, techniques, especially in the case of multiple-input, 
multiple-output problems. In the last years, several computer-aided 
techniques have been developed to try to overcome this deficiency, among 
them the diagonal dominance method presented by Rosenbrock (Rl) is widely 
used for multivariable systems. But still, there isn't yet, a frequency 
domain technique that could be compared in scope and versatility, to the 
linear quadratic design in state space form. 

For this reason, the approach of this chapter will follow path 2 
shown in the above graph. 

The importance of step 2 (cj) lies in the fact that for systems that 
do not require the use of a computer, the compensator can be built very 
easily using only delays and gains that are readily available. When com- 
puters are used to implement the control, this structure is also very con- 
venient since a stack can be created and very few memory locations will 
be required. 

This chapter, as mentioned above, mil consider the problem of 
designing an optimal compensator whose dynamics are constrained to be 
those of a discrete time minimum order observer. The initial, as well 
as the final form will be a matrix difference operator. The initial con- 
dition of the plant will be a random vector with known rirst and second 
order statistics, and the cost to be minimized will be the expectation, 
with respect to the initial condition, of the standard quadratic cost for 
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the discrete time linear regualtor problem. 

The structure of this chapter is as follows. In section two the 
discrete time linear regulator problem is presented* Section three deals 
with the structure of the discrete minimum order observer as suggested by 
buenberger (Ll) - In the fourth section of this chapter the optimal con- 
trol problem is formulated and the equations that must be satisfied by 
the unknown parameters of the compensator are developed* Also the neces- 
sary conditions for optimality are presented but not worked out (based 
on Lloren T s thesis (L2) * In the last section, the transformation from 
state space form into an Auto-Regressive Moving- Aver age model along with 
the structure of the matrix P of the compensator and some pertinent re- 
marks are presented* 

2* THE DISCRETE TIME LINEAR REGULATOR PROBLEM 

This section considers the problem of finding an optimal compensator, 

given the fact that complete state measurements are available- The initial 

condition of the plant is assumed to be a random vector with known first 

and second order statistics- The performance index to be minimised is 

the expectation of the usual cost, quadratic in both states and control. 

* 

Since this problem is well known, only the problem formulation and the 
results are presented. 

OPTIMIZATION PROBLEM 
Given: 
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(a) : The following minimal realization discrete time linear invariant 

plant 

x(t-KL) - A x(t) + B u(t) (1) 

on the time interval t [0,“) where 

x(0) is an R n random vector with known first and second order 
statistics * 

x (t) an R n - valued random process 

p 

u(t) an R - valued random process to be determined 
A a constant real n x n matrix and 

B a constant real n x p matrix 

(b) : The symmetric matrices Q and R where 

Q is an n x n constant real symmetric positive semidefinite matrix 
and 

R a p x p constant real symmetric positive definite matrix 

Find: the optimal control u(t) which minimizes the performance index 

J(u) given by 

CO 

J(u) = E l x 1 (t)Qx(t) +u'(t)Ru(t) (2) 

t=0 

As it was pointed out before, the solution of this problem is a 
well known result given by 

u (t) = G x(t) 

where 
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G = {R -r B'KB}” 1 (3) 

and K is a symmetric matrix -chat satisfies the discrete time algebraic 
Riccati equation 

-1 

K = A T KA tO- A T KB (R t B'KB) B *‘KA (4) 

The minimal cost to go is then obtained as 

= tr{K S Q ) (5) 

= Etac(O) x* (6)). 

It can be shovm that K satisfies also the following equation 

K = (a + BG) 'K(a + BG) t 0 + g’rG (6) 

The sufficient conditions that must he satisfied for K to he the 
unique positive definite solution of (4) are 

(a) (A,B) is a completely controllable pair and 

(b) (A ; Q^) is a completely observable pair 

2. STRUCTURE OF THE DISCRETE TIME MINIMUM ORDER OBSERVER BASED COMPENSATOR 
In the previous section, it was assumed that complete state measure- : 
meats were available/ but in most applications only a certain number of 
states (usually very few of them) or some linear combination of them can 
he directly observed. This lack of measurements poses a very serious 
problem in the implementation of the optimal linear regulator/ since the 
control law, instead of being just a linear combination of the states 


iT* 


where 


So 
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becomes dependent on time as well as the observed states* Thus, either 
a new approach that directly accounts for the nonavailability of the 
entire state vector must be devised, or a suitable approximation to the 
non available states must be determined. The latter was the direction 
taken by Luenberger (LI) when he proposed the construction of an observer 
that would approximate assymptotically the non available states. It turn 
out as it will be shown in the next section, that the insertion of the 
observer doesn’t change at all the value of the feedback gain matrix G, 

The only thing that changes is that instead of feeding back the entire 
state vector, the observed states plus the estimates of the unavailable 
states are the ones that are fed back. So the first phase in the imple- 
mentation of an optimal control law should be to assume that the entire 
state vector is available for feedback* while the second step should be 
to design a system that will approximate assymptotically the states of 
the original plant, i-e. f to design an observer* When the notion of an 
observer was first introduced, it was used primarily for the approximation 
of the states of deterministic, continuous time, linear time invariant 
plants, but, the observer theory has subsequently been extended to include 
time varying systems, discrete time systems and stochastic systems* Of 
course, the construction of a minimum order observer is not the only 
solution to the problem of finding an optimal compensator, Levine (L3) 
proposed the use of an optimal output feedback controller, however, not 
all systems are. output stabilisable which could cause an unstable system 


to remain unstable* Some other strategies that could be used are 

a) to build a full state observer: this approach has all the 

mathematical simplicity of the minimum order observer's, but 
implicitly, it possesses a certain degree of redundancy. He- 
dundancy that arises from the fact that the observer V7ill be 
estimating the entire state, while we already have certain states 
through the outputs of the system, and 

b) to implement an observer that will reconstruct asymptotically 

the optimal control law u(t) - G x(t) as proposed by Fortmann 
and Williamson (F2) : this technique has the advantage that the 

degree of the observer can be less than that of the minimum 
order observer, i.e., less than (n-m) but also possess the great 
disadvantage of mathematical comp3 xity, and it has not been 
worked out yet for multiple input multiple output systems* 

For these reasons, we have selected to find the optimal compensator based 
on the structure of a minimum order observer* 

Let a minimal discrete time , linear time invariant system be governed 
by the following equations 

x(t-M) = A x(t) -r B u(t) ‘ (1} 

y ft) =■■ c x(t) (2) 

where 

y(t) is an R m random process described by (!) and (2) 

C is an m x n constant, full rank matrix 
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Furthermore , let us assume that C has the following structure; 

C - [X m : 0] (3) 

where 

X is the m x m identity matrix and 
m 

0 is a mx(n-m) aero matrix. 

This is in no way a restriction on the range of systems that we can 
deal with, since from the assumptions that the system is minimal and 
that C is a full rank matrix, a similarity transformation can be found 
that will give us the desired structure. In fact, Blanvillain (Bl) shows 
a way to get this transformation. 

Having the system in this specific form, we can partition CL) and 
(2) in such a way to get 


x(t+l) 


11 

$ 

' A ii 

\ 2 " 


*j (ti 

+ B l“ 

< — 
to 

H 

ll. 

A 21 

"22 


*2 Ctl 

B 2 


C4) 


y{t) = [I : 0] 
m * 


x 1 (t) 

x 2 Ct) 


"* x i (t) 


where 

x^ (t) is an random process 
x 2 (t) is an R n m random process 



f 


A^(m x m) , A 12 (m x n-m) , A^Cn - m x m) , (n - m x n-m) , 

<B^ (m x p) , B 2 (n-m x p) are real valued matrices 

It can be readily seen that the output y(t) will give us directly 
x^ (t) , so an observer should be built to estimate only x 2 (t) . 

Expanding (4) we obtain 

x 2 (ttl) = A 21 x^Ct) + A 22 x 2 (t) + B ? u(t) * (6) 

x 1 (ttl) = A 1 1 x 1 (t) + A 12 x 2 (t) + B 1 u(t) (7) 

Substituting (5) in (7) an rearranging some terms we get 
y (t+1) “ A 11 y(t) - B 1 u(t) - A 12 x 2 (t) (8a) 

Now, let 

y (t+1) - A in y(t) - B.^ u(t) = w(t) (8b) 

Therefore, systems (6) and (7) can be eiqpressed as 

x 2 (t+1) = & 22 x 2 (t) + A ?1 y(t) + B 2 u(t) (9) 

w(t) = & 12 x 2 (t) (10) 

If we can measure w(t), equation (10) provides the measurement 
a 12 x ? (t) for the system (9) which has state vector x 2 (t) and input 
& 2 i y (t) + B 2 u(t). Provided that w(t) can be computed, . the only problem 
lies in the fact that (A ,& ) has to be completely observable. This 

problem is readily solved since by assumption (A,C) is completely observ- 


able (see Padulo and Arbib (P2) ) ■ 


The idea behind the construction of the observer is then as follows . 



L_J 



PLANT 

Figure 2 











I 
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Since u(t) and y(t) are measurable, let us build a system with the exact 
form of (9) and (10) - Then we have 

x 2 (t+l) = A 22 x 2 (t) -f & 21 y(t) + B 9 u (t) (11) 

w{t) “ A 12 X 2 (t) (12) 

But, since any errors in the initial state or disturbances of the system 
would make our approximation to :< 2 (t) very bad, let us keep track of the 
error between w(t) and w(t) and feed it back to the system through the 
matrix H, as shown in Figure 1. 

So, we get the structure of the observer as follows 

X 2 (ttl) - A 22 X 2 (t) + A 2JL y (t) -r B 2 u(t) + H(w{t)-A 12 X 2 (t)) (13) 

Therefore 

j£ 2 (ttl) = (A 22 - HA 12 )x 2 (t) + A 21 y(t) + B 2 u(t) +' H w(t) (14) 

Substituting (8b) in (14) we obtain 

X 2 (ttl) = (A 22 - HA 12 )x 2 (t) + (A 21 - HA lx )y (t) + (B 2 - HB 1 )u(t) 

-r E y (t-HL) (15) 

Now, in order to eliminate the y(t+l) term from equation (15), let us 
define 

z(t) = x 2 (t) - H y(t) (16) 

Finally, inserting (16) into (15) we obtain the desired structure for the 
. observer as shown in Figure 2. 
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Note from equation {17) r that the observer dynamics are determined 
by the eigenvalues of s ^ nce the pair (A^, is complete- 

ly observable, it can be shown using duality, that the poles of the system 
can be arbitrarily chosen by manipulation of the matrix H, This suggests 
that the closer the eigenvalues of the system are to the origin the better 
the observer, since it would yield an extremely rapid convergence. This 
tends, however, to make the observer act like a forward shift which 
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intro duces several difficulties. So, it is common practice to let the 
dynamics of the observer be just a little faster than those of the plant. 

This uncertainty of not knowing how to choose the dynamics of the 
observer, led during the last decade to some research in this area, in 
order to obtain the parameters of the H matrix by minimizing a cost. 
Blanvillain (Bl) , working tha continuous time problem, assumed the optimal 
control to have the same structure as the optimal control for the linear 
regulator problem, and then minimized the increment in cost due to the 
use of the observer. Miller (Ml) minimized the standard quadratic cost, 
constraining the control law to be an affine function of x(t). Also 
Newman (Nl) , Horn and Sarachick (Hi) , Yuksel and Bongiomo (Yl) among 
others contributed in the solution of this problem. The approach to be 
developed in the next section will follow Blanvillain’ s method. 

4. THE MINIMUM ORDER OBSERVER BASED COMPENSATOR PROBLEM 

In this section the actual control problem is solved. As was 
pointed out earlier, we start with a matrix difference operator equation 
and based on the results obtained in chapter two, transform the system 
to a state space representation. As was shown in the previous section, 
all the parameters of the compensator can be obtained, once we find the 
matrices H and G. These matrices are found by minimizing the expected 
value with respect to the initial conditions of the standard quadratic 
cost. The solution of the optimization problem reduces to finding the 
solution of two independent discrete time algebraic Ricatti equations. 
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This separation is achieved by working with x (t) , the states, of the plant, 
and e (t) , the error in the estimation of x (t) , instead of working with, 
the more natural variables x(t) and z(t), which lead to less tractable 
equations* The sufficiency conditions are presented at the end of this 
section. 

Assume that an irreducible system is given to us in the following 

form: 

£(D y ft) - Q(s) u (t) CD 

where 

P(z) is an m x m matrix difference operator 
Q(z) is an 1 x p matrix difference operator 

and we have incorporated the matrix R as defined in chapter two 
into P (z) . 

It was shown in section three ox chapter two, that the plant (D can be 
transformed into a minimal state space representation of the form; 

Xg (t-KL) = A 0 x Q (t) t B q uCt) C2a). 

y (t) = c Q x Q (t) (2b) 

where 

A q (n x n) is in observable form. 

B Q (n x p) is a constant real matrix 
Cq (m x n) is a matrix given by 
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with 

T (m x m} and C Q (m x n) as defined in chapter two. 

As pointed out in the previous section, we want the C matrix to be of 
the form 

c - ci : o] 

m - 

In the next section, v/hen we discuss the structure of P, a transformation 
that achieves this goal is fully presented* For now, let us assume that 
we have the desired structure and proceed with the statement of "the 
optimisation problem- 
Given: 

a) r{x{0)} = m Q and E{x(0)x r (0)} = for the process 

x(t-rl) - Ax(t) ■+ Bu (t) r t£[0,<») (3) 

y(t) = [I ! 0] x(t) (4) 

m . 

b) The matrices A and B for the above process 

c) The weighting matrices Q(n x n), R(p x p) such that 

0 is a constant real symmetric positive semidefinite matrix 
R is a constant real symmetric positive definite matrix 

Find: the matrices G(p x n) and H(n-m x m) and the .vector s{0) 

such that the cost 

CO 

U = E •{ j\ X 1 (t)O x(t} - 1 - U 1 (t) R u (t) } 

t^O 

is minimised subject to 
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x(t+l) = Ax(t) + B u(t) 

z <t+l) = Fz(t) + S y{t) + D u(t) 

y(t) = C x(t) 

u(t) = K ± y (t) + K 2 z(t) 

where 


F = 
S • = 
D = 


^22 ~ ^12 

+ te 21 - V 


B_ - HB 
2 1 


K, 


= G 1- G 2 H 


= G„ 


as noted before, this formulation leads to a series of intractable matrix 
equations that can, however, be avoided by using e{t) = the error in the 
estimation of x 2 (t) , instead of z{t). So, let us define e{t) as 

e(t) = x 9 (t) - x 2 (t) (5) 


Therefore 

e (t4-l) = F e(t) (6) 

And 

a (t) = x 2 (t) - H y(t) - e (t) / ' (7) 

We can now state the problem as follows; leave everything in the 
previous formulation unchanged but modify the constraints to read 
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x(t+l) 

= Ax(t) + Bu(t) 

(3) 

e (t+1) 

= (a 22 - na 12 )e(t) 

(9) 

u(t) = 

= Gx(t) - GI> e(t) 

(10) 

e(0) = 

= x 2 (0) - H y (0) - a(0) 

(11) 

y (t) = 

= ^(t) 

(12) 

where 



L - 

"* °rax (n-m) ' . 

. 1 (n-m) x (n-m) _ 


Define now the new augmented state 


?<t) = 

"x(t) ‘ 
- e(t) - 


Then we can make use of (8 ) , (9) , and (10) 

to write the overall closed 

loop system 

in the following form 


?(t+D 

4J 

II 

( 13 ) 

where T is given by 


r = 

A -r BG ~BGL 

(14) 

■ 

0 *22 - m !2 

- 


and of (11) to obtain the overall initial conditions as 
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5 ( 0 ) « 


’x(O)' 
e (0) 


5 ( 0 ) = 


x(0) 


x 2 (0) -Hy(0) - z(0) 


(15) 


We are now ready to solve the above optimisation problem. The cost J 
can now be rewritten as 

CO 

J = E ii 5' (t) fi 5(t)} (16) 

t=0 


where (2 is given by 


a = 


O -r G'RG -G’RGL, 

-L G'RG L'G'RGL 


(17) 


Using equation (13) we can see that 5(t), the augmented state at time t, 
can be found as a function of the initial augmented state 5(0) as follows 


5 (t) = r 5 (o) 


(18) 


Substituting (IS) into (16), the cost J can be expressed as a function 
of 5(0) 

CO 

1 1 t 

^ nT! 


J = e il 5’ (o) r t S2r g( 0 )} 
t=o 


( 19 ) 


which can be computed as 

'co 


j = tr {( l r ,t: r fc ) s (o) } 


( 20 ) 
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where 

S (0) = E{?(0)?‘ (0)} (21) 

In order to find the value of J, we then need to compute only 
00 

I a i* = a (22) 

t=o 

which can he found as a solution of the discrete time Lyapunov equation 
A = r> A T + Q (23) 

Therefore 

u = tr{A E(0) } (24) 

EVALUATION OP S (0) 

Recall from (21) that 
E (0) = E{£(0)5* (0)} 

and from (11) that 

e(0) = x 2 (0) - HSc^d) - z (0) 


so 
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In order to compute E^ 2 and E Q , we need to partition the matrix 
2^ and the vector nig as follows 

- f 2 ll S 12 

o' z z 

12 22 

1 -m* 



according to the dimensions of :s^(0) and x 9 (0) . So 

2 12 ~ 2 1I H * “ m i S ' ^ 

2 22 ~ 2 12 H ' ~ m 2 a> ^ 

and 

E 0 = *{.«)•■ (0)> - SE^ H' + Z 22 - Z^H' - HZ^ - 


\ 2 e{x( 0) e' (0) } = 




- (m 2 - (0) 4- z (O)z’ (0) (27) 

EVALUATION OF A 

Recall from (23) that A is given by 

... A. = r* A V + £ 2 .. 

where T is given by (14) and £2 by (17). 

Partitioning A as 


where 


is an n x n symmetric matrix 
A^^ is an n x(n-m) matrix 
a 22 is an (n-m)x(n-m) symmetric matrix we 

we obtain 






(A + BG) ' 0 


- (BGIO 1 (A 22 -Ha 12 ) ’ 


fA, A ‘ 

11 12 


A+BG — B( 


A’ „ A oo 

12 22 


O + G'RG - G'RGB 

. -L'G'RG L'G'RGL.; 

T ■* 

Expanding (28) we obtain the following three matrix equations 
A^ = (A+BG) ' (A+BG) + 0 + G'RG 

A = - (A+BG) ’A^BGL + (A+BG)'A i2 (A 22 -HA 12 ) - G'RGL 

A 22 “ BGL - 
+ (a 2 2 - Ha i 2 ) ' A 22 <a 22- ia i2 ) + i’S'SGL 




Comparing equation (29) with equation (6) in section one we get 


An = a* A i;l a + q - a'A i1 b(r+b , 'A 11 b)" ;! 'b'A 11 a 

and 

G = - (R + b'A 11 B)'' 1 b , A 11 A 

From (30) we obtain 

A 12 = -a'A BGL - g'b’AuBGL - GRGL + (&+BG) ' A 12 (A 2 2 -Ha i2 ) 

A 12 55 -a’Aj^BGL - g'uw-b'Aj^BJGL + (&+BG) ’A^ (A^-HA.^) 
and substituting (33) into (35) 

A 12 = <*»“> , A ia » 22 -^i 2 ) 

If the analysis of this problem is done for the finite time interval 
and then the limit is taken, we will find that 



Substituting (37) and (33) in (31) we get 

A 22 " ta 22-‘ a i2 ) ’ A 22 !a 22-®12 , - 1 ' G ' !B ’ A 11 M - 

Recall now, from (24) that 

CO) 


(32) 

(33) 

(34) 

(35) 

(36) 
[ 0 , 1 ] 

(37) 

(38) 
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J = trOL^) + tr(A 22 E Q ) (40) 

Comparing equation (5) of section one with (40)/ we see that the inclusion 
of an observer in the system to estimate the nonavailable states has the 
effect of increasing the cost by 


= trCAjj V (41) 

The idea now is to find the optimum parameter H and s(0) such that 
the increment in the cost, AJ, is minimised, so we want to solve the 
following minimization problem- 
Given: 

A 22 " (a 22- Ba i2 ),A 22 <a 22- Ha i 2 > - L ' G,B ' A li aL 

where G and are described by equations (32) and (33) t and 
obviously independent of H and z (0) - 
b) 3 0 = + J 22 - Zj. 2 H - HZ 12 - z (0) (m^.) ' - 

^(■ 2 -aiL)z' (o) + s (o) z* (o) 

Find the optimum parameters of H and z (0) such that the increment 
in the cost 
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AJ = fcr ( A 22 E 0 5 

is . minimised. 

Llorens proved (l 2) that the above dynamic optimisation problem can 
be transformed to a static optimisation problem, using a technique similar 
to the Lagrange multiplier method used to solve minimisation problems in 
calculus. This static optimization problem becomes of the form 


Ao tr{A 22 E Q ’ f&22 KB, 12^ ^22 ^'22~ HA 12^ L G bA^AL A 2 2^ K 

(42) 

to = tr( A 22 hZ^h" + A 22 £ 22 - A 22 - A 22 HE 12 

- A 22 s (0) (m^Bm^ ) ' - A 22 (m 2 -lfin. 1 > z ’ (0) * A^zfOjz ' (0) 

+ C»22- Ha i2 > ' A 22 <a 22- Ha i2 ) ‘ L ' G ' B ' A 11 M ' V' (43) 


The necessary condition for (43) to have a stationary point at z*(0) , K * , 
H*, A * are the following: 


9j 

3s (0) 


9 J 
3K 


= 0 


= 0 


3u | 

3h 1 


(44) 


(45) 


0 


(46) 
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where | # means ” evaluated at the stationary point 11 


From (44) 


A* 2 s*( 0) - A 22 {m 2~ H * m l ) = 0 


z* (0) = m 2 - H*m 1 


From (45) 


(A 2 2~H*Ai2) A" 2 (A 22 -H*A 12 ) l , G B A^AL 


From (46) 


0 = A * h*2 - A* 2' t A* z*(05m' - A* A K*a' 

22 11 22 12 il 22 1 ; 1 n 22 22 12 


+ A l2 E * a i2 K * a i2 


K - + E 22 - Li 2 H*" - H* 12 - 

- +z*(0)a*'(0) + (a 22 -H*i 12 ) K* (a 22 -H*i 12 ) ' 


Substituting (48) in (50) and solving for H* we get 
H* - (^ 2 -= a »i-<-a 22 K*^ 2 )(S 11 - ! n 1 mV^ ftl2K *^ 2 )' 
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and substituting (48) in (51) 


K* = < a 22 - H *\2 )K * <a 22- H * a i2 ) ' - Vi ”'*' 


+ S 22 m 2 m 2 ^12 m 2 m i^ H " “ H ’ ’^12 " m i m p 


(53) 


which becomes, after some manipulations 


A 22 K * a 22 + ^22 “ m 2 m 2 ™ ^12 ~ m 2 m i + A 22 KW " 12 ^ * 

-(Zii - m^m^ + A i2 K * a i2^ ^12 ” m i m 2 + A 12 K * A 22^ 


(54) 


Summarizing, the optimal compensator parameters H,G, and z(0) can be 
found as follows 

Feedback gain 


G n 


where 


< S + B ' V ' -1 ®' V a 


All = »• Alii + fl - A 1 AuB )-^ An * 


Parameters of the observer 


■ \ - 


H (Z 12 - + A 22 KA 12^ ^11 " m l Itl l ' A 12 KA 12^ 


where 


K = * 22*^2 + Z 22 “ m 2 m 2 " (S 12 " V *! * A 22 KA 12 ) * 


.,-1 


(^n - m ^ t A 12 Ka 1 2^ ^12 ” m i m 2 : A i2 Ka 22^ 


and 


2(0) = m 9 - Hm_ 

Notice from the above equations, that the separation that was re- 
ferred at the beginning of this section holds. The feedback gain depends 
only on the plant parameters and the weighting matrices, while the parameters 
of the observer depend on the plant structure and the statistics of the 
process. This observation is very important since it allows us to con- 
struct the observer and the feedback gain of the compensator independently 
of one another - 

Apart from the assumptions that were made through the development 
of the optimal compensator, if we assume that (2^ - m^) is positive 
definite, the transfer function of the observer will be unique. Further- 
more, Blanvillain and Johnson (B2) found that the plant transfer function 
uniquely determines the transfer function of the compensator. 

Llorens (L2) presented the conditions that must be satisfied in 
order to guarantee the existence of positive definite and K matrices. 
These are 

a) {A,B) be a controllable pair 

1/2 

b) (A,Q ) he an observable pair 

and 

c) (A 9 ' 2 - A 1 * 2 (S^-m^m^) “(S^ 9 - m^m^) , A ’ ) be a controllable pair 
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^22 a i2^11 ~ Vl 1 ^12 m i m 2^ ' ^22 ~ m 2 m 2 ^12 m 2 m P 


(S i;l - m l mp 1 (S 19 - be an observable pair 

e) (2^ - m^m^) is a nonsingular matrix 


Condition c) is satisfied if the. pair (A,C) is observable. These 
conditions, especially a) and the implication of condition c) that the 
pair (&,C) be observable, are the main reasons that led us to construct 
a minimal realisation from the original matrix difference operators. 

5. THE A.R.M.A. COMPENSATOR 


In the previous section we found the structure of the optimal observer 
based compensator by minimising a performance index. Since we want a 
minimum order observer, it turns out that the input to the system depends 
not only on the estimates of the nonavailable states, but on the output 
itself. This is an idealized situation for purely synchronous discrete 
time systems , since it is impossible in practice to feed back the measure- 
ment at time t without any delay. Three different ways get around this 


problem are: 

a) build, instead of a minimum order observer a, full state observer: 
this approach would have all the mathematical simplicity, as well 
as properties, such as the separation between gain and observer 
parameters equations, found in the development of the optimal 
m inimum , order observer based compensator. In practice, this 
method won't increase the order of the observer by too much since 
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generally, the number of outputs even for complex systems/ is 
small compared to the number of states 

b) try to find another structure for a compensator/ hopefully of 
degree less than n that will feed back an estimate of the states 
plus a combination of the outputs at time, say/ t-1 

c) construct a "nearly synchronous 11 controller that wil be able to 
compute u(t) at (t+A) / A<< 1 such that the output at time t 
could have enough time to be fed back. In this case the same 
compensator found in the previous section would be used. 

In this section/ we will assume that the optimal compensator already 
found is realisable/ and then we will transform the state space representa- 
tion of the compensator into a matrix difference operator form, using the 
technique presented in section four of chapter two- We will also find the 
structure of the matrices a and P used in the previous section/ and show 
that P is in observable form. 

We are interested here to find then the optimal compensator transfer 
function. Pvecall from the previous section that the equations satisfied 
by the optimal compensator axe 


z(t-KL) = Ps (t) t S y(t) t D u(t) 
u(t) = K x y(t) + K 2 z(t) 

where 


P — 1 - Ha _ is an (n- m)x(n-m) matrix 


S = FH -7 


H- - HA^ is 311 (nxm)xm, matrix 


( 1 ) 

C2) 
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D - 3 2 - is an (n-m) xp matrix 

= G^ + G^H is an p x m matrix 
— G^ is a p x (n-m) matrix 

Prom (1) and (2) 

z(t) = (zI-F) -1 S y(t) + (ZT-P) _1 D u(t) (3) 

u(t) = K^y (t) 4* K^s (t) (4) 

Substituting z(t) from (3) in (4) we obtain 

u(t) = K x y(t) + K^zl-F)" 1 Sy(t) + K 2 (zI~F) - 1 D u(t) (5) 

Finally rearranging terms we get 

(Ip - K 2 (zI“F)~ 1 D)u(t) = (K x 4- K 2 (zI-F ) ~ L S ) V (t ) (6) 

which is a transfer equation from output to input. 

Note that the system described by (6) is not irreducible, but at 
any rate, we are not concerned in this section to obtain a system in 
irreducible matrix difference operator form. It is important to note 
also, that since it is needed to compute (zI-F) - on both sides of (6), 
we can multiply both and by det(zI-F) and then cancel the 

that will be present on both sides. In other words 

(det (zI-P ) I p - K 2 (adj (al-F) ) D) u (t) =■ (det (zI-F) K,* 

+ K 2 (adj (zI-F))S)y(t) (7V 

and here is where Faddev's method to compute the adjoint of a matrix be- 


comes handy. 
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COMSUTAIION OF det(zI-F) AND adj (zI~F) 

Note from section four of chapter two that if the det(zI-F) is given 
by 

det(zX-F) = z -p.z - p z - ... - p„ „ (3) 

s. jL n-m 

and the adj (zI-F) by 


n-m-1 . _ n-m-2 

ad] (zX-F) = Iz -r J^z 


we can compute simultaneously p^ r P 2 r*. 
Faddeev's algorithm 


J 2 Z 


n-m3 


. J 


( 9 ) 


n-m-1 

/P„ ™ and J i f J o' * ■ • r' J -r, m 1 usin 9 
n-m 1 2 n-m—l 


V 

= F 

P 1 

= tr (F x ) 

J 1 

= jt x - Pl x 

F 2 

r-\ 

II 

*2 

= ~ tr(F 2 ) 

J 2 

= * 2 - P 2 1 

F 3 

“ FJ 2 

P 3 

= jtr(P 3 ) 

J 3 

" P 3 “ V 


F . = FJ 

n-m-1 


_ p — — v -j ) 

n-m-2 ~ n-m-1 n-m-1 n-m-1 


F = FJ ' 
n-m n-m-1 


p = — — f:r (F ) 

n-m n-m n-m 


J . - F -p . 

n-m-1 n-m-1 n-m-1 


(10) 


Inserting (8) and (9) into (7) we obtain 

,, n-m n-m-1 . _ „ n-m-1 _ n-m-2 

E(z - P-,z - " Pn-m U p " V IZ * d V 


■ -r #- > v r i n— m n— m— 1 

+ --- + J )D]u(t) = [(z - P n z 

n-m-1 1 

. ,, n-m-1 , „ n-m-2 • . _ ... 

t- ^{Ts + J-jZ + ... * u n _ m _y^ s 5Y (t) 


- p )K_ 
*n-m 1 


cil) 


which reduces to the Auto-Regressive Moving-Average form 
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I u (t+n-m) - <p_ I +K D) u (t+n-m-1) - . 
P 1 p 2 


* ~ ( Pr, m Z « + K o J „ „ TD)u(t) 
n~m p 2 n-m-1 


= K y (t+n-m) - (p K -K S)y (t+n-m-1) - ... - (p K.-K.J _S)y(t) (12) 

. x x z n-m 1 2 n-m-1 

Notice that the number or multiplications required to obtain each 
new input is 


( tt+P ) (n-m) + pm 


(13) 


This number can be reduced if instead of using (6) we compute the 
transfer function of the system as follows: Substitute (2) into (1) to 
get 

z(t+l) = (P-5-DK 2 )z(t) + (S+DK^)y (t) (14) 
Taking the Z-transform in both, sides we obtain 


z(t) = [zI-(P+DK 0 )l " (S+DK^) y (t) 
to finally substitute (15) into (2) to get 


(15) 


,-l, 


(16) 


u(t) =' (K 2 [zl-(P+DK 2 )3 (s+DKj.) + K,)y(t) 

Employing again Paddeev's method to obtain both det [zX- (F-rDK^ ) ] and 
adj [si- (PHrDK 2 ) ] we get 

I u (t-i-n-m) — r I u (t+n-m-1)- — - r I u(t) = K,y (t+n-m) 
p 1 p n-m p 1 

- (r^-*^ (S+DK^Jy (t+n-m-1)- ... - ( r n _ m \- K 9 M n -m-l {S+DK l ))y(t) C17) 

where 


^ > p . i - . . t _ i . Hi 3a 'iii 1 xi 1 ui 2 

der[zI-(FT-DK 2 )] = z - r^z - r 2 z - ... - r 


n-ra 


and 


adj [a I- (F+DK ) ] 2 = la 11-111 " 1 + M.z n_m 2 + ... + M . 

x n-m-x 

Notice that the number of multiplications required by using (17) has been 
reduced to 

(pm-fp) (n-m) .+ pm (18) 

STRUCTURE OF THE A AND F MATRICES 

After using Wolovich's method in the previous section to achieve the 
transformation from a matrix difference operator form into a state space 
representation, we pointed out that a similarity transformation was 
required in order to put the system into state output canonical form. 

We will present now one transformation that will give us the matrix F in 
an observable form. 

Recall from equations (2a.) and (2b) of sections four that we have a 
completely observable system of the form 

X Q (t-rl) = AqXq (t) -5- B q u(t) (19) 

y(t) = C Q x Q (t) (20) 

where 

A Q (nxm) is in observable form 
B^fnap) is a constant matrix 
C Q (mxn) is a matrix given by 

S - r R ? 0 

that we want to convert into state output canonical form. That is, we 
want to find a similarity transformation given by 
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x(t) 

- 

that 


x(t) 

-1 , , 

= JA q J X (t) 

y(t) 

-1 . . 

= c Q cr x {t) 


is in state output canonical form. 

Let us look at the structure of in order to find the desired J 


C - . 0 0 ..... 0 


0 0 .. 0 


0 r“J- 0 0 

cl 


o r J ... r 1 

c2 cm 


—i —X “i th. 

where T 7 nf .. V denote the first, second, and m columns oi 

cl c2 cm 

P ^ and r , r_,..-,r are the r_. , r _ columns of C_ as defined by. 

1 2 m 12 m 0 

(8) in section three ox chapter two. We see that if we define J ^ as 
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J " 1 - 


0 

0 .. 

0 


1 

0 .. 

0 

0 

0 


0 

0 

♦ * * 

0 

0 

0 .. 

0 

p ’ 

0 

1 .* 

0 

0 

0 


0 

0 

* * m 

0 

0 

0 .. 

0 

p 

• 

0 

0 

1 

0 

0 


0 

0 

• m * 

0 

“ 

Irl 

- 

m 

0 

0 

0 

0 

0 


0 

0 

- * # 

0 

0 

0 

0 

* 

0 

0 

0 

1 

0 


0 

0 

* * p 

0 

0 

0 .. 

0 

* 

0 

0 

0 

0 

1 


0 

0 

• * m 

0 

0 

0 . .. 

0 

■ 

0 

0 

0 

0 

0 


1 

0 

m m m 

0 


‘ r r2 

—■ 


0 

0 

0 

0 

0 

# * 

0 

0 

# « ♦ 

0 

0 

0 ... 

0 


0 

0 

0 

0 

0 

p p 

0 

1 

• p m 

0 


(25) 


m 


00 ... 0 
„ T _ 

rm 


0 0 0 0 0 .. 0 0 ... 1 
0 0 000 .. 0 0 


m 


n-m 


where r ,r , ... ,r denote the r ,r , ...,r rows of J 1 and T - , T 

JL<d HI 1 Z in 2:X 3r2 

Xh 

r are the first, second, . , and m rows of T. 

Then C will be in state output canonical form, i.e. , 


C 



Htx (n-m) 


] 


(26) 



where the | columns denote columns of numbers - 
Recall now that P is obtained by 


F - “22 " 


So, from (29) and (30) we can finally find the structure of F to be 


given by 
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1 — 

0 

0 

w w + 

0 i 

0 

0 

« 4 • 

0 

0 

4 ■ » ' 

0 



1 

0 

* m- + 

0 

0 

0 

• t t 

0 

0 

• » • 

0 



0 

1 

+ m m 

0 

0 

0 

* * fc 

0 

0 


0 





* 

m 




* 



* 




0 

0 


1 ! 

0 

0 

... 

0 

0 

. • 

0 



0 

0 

4 » # 

o 1 

0 

0 

* * * 

0 

0 

' * . * 

0 



0 

0 

• * # 

0 

1 

0 

... 

0 

0 

. . „ 

0 



0 

0 

w • ** 
* 

o I 

0 

1 

* 

0 

0 

• . . 

o 



0 

0 

4 

r 

0 ] 

0 

0 

* 

1 

0 

* 

■# 

o 



0 

0 

« v t 

0 i 

0 

0 

... 

0 

0 


o 



0 

0 


o 1 

0 

0 

... . 

0 1 

1 


0 



0 

0 

4 

M 

9 W 

1 

0 ! 

0 

0 

* 

* 

□ 1 

0 

4' 

♦ 

1 ; 


: M 












. J 


which is the multivariable observable form. 

REMARKS 

a) Taking advantage of the structure of F and using (1) and (2) , 
we find that the number of multiplications needed to obtain each new in- 
put working in state space form is (2p+2m) (n-m) + pm. Comparing this 
number with (pm+p) (n-m) + pm, the number found for idle Auto-Regressive 
Moving-Average model, we note that for systems that have a small number 
of inputs, the difference is not that big. We need cc have in mind also 
that the A.R.M.A- structure found is not irreducible, so for specific 
problems , some extra sayings in the above number of computations can be 
achieved. 

b) As was pointed out earlier y one of the big advantages of having 
the system in an A-R.-M.A- form is that for simple systems the implementation 
of the compensator can be done with readily available elements, and for 
more complex systems a stack can be created, which allows us to avoid 



67 ' 


core memory accesses, a characteristic that speeds up the computation 
time* 
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CHAPTER IV 

INTRODUCTION ' 

In this chapter we will present three different methods to obtain 
minimum variance control strategies for single input single output 
discrete time systems* The main reason to build these types of com- 
pensators is to reduce the effects that noise has on the plant* As will 
be seen in the example solved in chapter five, these procedures do not 
guarantee the stability of the compensator. Even though the compensator 
will not be necessarily stable, the overall system will be. In order to 
avoid the problems pointed out in the previous chapter, it is assumed 
that the compensator computes each new input as a function, solely, of the 
past information available, i.e., u{t) depends only on the previous inputs 
u (t-1) , u (t-2) , * . . and the previous noisy measurements z (t-1) , z (t-2) , * . * . 

The structure of this chapter is as follows. In section two the 
necessary conditions to achieve a minimum variance control for a noisy 
system with noisy measurements are obtained. This is a direct method 
since it will not be necessary to transform the system into a state space 
representation. This technique has the great disadvantage that even for 
very low ordered systems the equations become untractable. Section 
three deals with the same problem, but the system is converted to state 
space form. Although the structure assumed for the compensator does not 
allow us to get a separation to obtain its parameters, as was the case 


I 

j 

■i 

i 

■ i 

' 1 


with the minumum-order based compensator solved in the previous chapter 
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the matrix equations that we get can be solved with the use of a computer. 
Section four presents the strategy developed by Astrora to get the minimum 
output variance control for a discrete time linear time invariant plant 
with noise-free measurements. It turns out that the compensator, us in g 
this method, is very easy to get. A simple polynomial division gives 
directly the parameters of the compensator as well as the numbers required 
to find the variance of the output. 

2. MINIMUM VARIANCE CONTROL-DIRECT METHOD 1 

As was pointed out in the introduction, the great disadvantage of 
this method lies in the fact that the equations that need to be solved 
are not difficult to get, but if obtained, difficult to solve. The idea 
behind this technique is as follows; once the structure of the com- 
pensator is assumed, substitute it into the transfer function of the 
original system, in order to obtain the transfer function of the overall 
system depending only on the transfer function from internal noise and 
measurement noise to output. At this point, we go back to the time domain 
and find the necessary conditions required to get a minimum variance Of 
the output. 

til 

Let us assume that an n discrete time linear time invariant single 
input system is described by the following Auto Regressive Moving Average 
equation; 

y(ttn)+a y(t+n-l)+ — -f a n y(t) = b _ u( t+n-l) + ... + b_u(t) + 
n.“j_ — u n-i u 

(t-f-n-1) 4- ... t c Q v (t) 


( 1 ) 


te: 

u(t) is the input to the system 

v(t) is the internal white gaussian noise such that 
E(v(t)) = 0 and cov(v(t)} = v<5 (t) 

Since the measurements are also noisy, let 

z{t) = y(t) + w{t) (2; 

where 

w(t) is a white gaussian noise such that 

E{w(t}) =0, cov(w(t) ) = W<5 (t) and E(v(t)w(t)) = 0 

' • th 

Now, let us assume that the n order compensator has the following 
structure 

u(t+n) f d , u{t-fn-l)-i- ... -f d_ u(t) - f „ 2 (t+n-l}+ ... 4- f_ s(t) 
n-x 0 n~x 0 

(3) 

* 

which can be rewritten as 

ufttnj-r d „ u(t+n-l)t . n(t) = f ,y (t-fn-1) t . - + f.y (t) + 

n-± u n-x 0 

j 

f w (t-f-n-1) + ... t f u(t) (4) j 

n-1 0 1 

■ ' • ' ' . ' *j 

Talcing the 2-transform of both (1) and (4) we. get 

(5) 


( 6 ) 
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where 


A(z) 


n . n-1 

z + a _z + . 

n-1 

+ 

a o 

B(z) 

= 

. n-1 

b _ Z * m m * T* 

n-1 

b o 


C(z) 


n-1 

Vi‘ + + 

V 


D{z) 

“ 

Z 1 -r d z n ^ + . 

... ■+ 

d o 

P(z) 


n-1 4 

X ' -2 -r , * - x 

n-1 

J= 

"0 



Substituting (6) into (5) we get 


B(z) F(s) . F(z) . C{s) ■ > . 


which becomes 


y(t> - . Blg)g(a> 


A(z)D (z) -B (z)F (z) 


w(t) t 


C(z)D(z) 


A(z)D(z)-B(z)F(z) 


v(t) 


(7) 


(S) 


Equation (8) describes the overall closed loop transfer function. 

Mote that since B(z)F(z) is of degree 2n-2 and A(z)D (z) -B (z)F (z) of degree 

2 the measurement noise at time t will be delayed twice before it is 

reflected on the output of the system; this is logical since this disturbance 

has to go through the compensator as well as the plant before it goes out. 

Observe also that since the order of G(z)D(z) is 2n-l the internal noise 

is delayed only once, this is because v(t) has only to go through the 

plant before it is reflected at the output. 

Having obtained the transfer f u n ct ion of the closed loop system we 

go back to the time domain to express 
t t 

y(t) = l h(t-n} w (n) + £ g(t-n)v(n) (9) 

n=0 n=0 
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where 


h(t) 


is 


the inverse Z-transform of 


B(g)F(z) 

h(z)D(z)-B(z)F(z) 


g (t) is the inverse Z-transform of 


C(s)D(z) 

A(g)D(z)-B(z)F(z) 


We are now ready to compute the variance of y(t) 

t t t 

E(y 2 (t)) = E[(. I h(t-n) w (n) + £ g(t-n)v(n))( l 


n=0 


n=0 


i=0 


h(t-i) w (i) 


4- I g (t— i)v(i) ) (10) 

i=0 


Recalling that v(t) and w(fc) are independent, (10) becomes 

2 t t t 

E(y (t)) = E( J h(t-n)w(n) £ h(t-i)w(i) + £ g(t-n)v(n) 

• n=0 i=0 n=0 

t 

^ g(t-i)v(i) ) (11) 

i^O 


Since E(* (n)w(i)) = W<5(n-i) and E(v(n)v(i)) = VS(n-i), we obtain 

2 n . a 

E(y (t) = l h (n)W + l g (n)V (12) 

n=0 n=0 


and talcing the limit as t 03 we finally get 

CO CO 

E (v 2 (“) ) - l h 2 (n)w -f l g 2 (n)V (13' 

n-0 n=0 

therefore/ the necessary conditions that must be satisfied to obtain a 
minimum output variance are 
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CO 


I 

n=0 


h(n) 


9h(n) 

3s 


co 

w + T 

n-0 


g(n) 


3g(n) v 

3s v 


Q 


0.41 


for each s, s being d d n _ 2 > 




We can see in (14) the difficulty to implement the compensator using 
this technique, because, not only to obtain g(n) and h(n) for n~0 f l r . 

is a tremendous task, but to solve the necessary conditions is almost 
impossible, since in almost every h(i) and g(i) there are present at least 
several of the parameters we are trying to find. 

In order to avoid these difficulties, we can use Farseval '■ s. relation 
to put (13) as follows 


IT 


E (y 2 (=°) ) = / H(e- JU )H*(e :iU )du + / G(e 3U )G* (e^ldu 


— TT 


2ir 


C15) 


and then the necessary conditions become 
w / H(e ju ) ■ du + W f H*(e ju )du -t 


"TT 


-TT 


V | ir G(e ju ) } du. + V / - G*(e ju )du = 0 


3s 

— tt -it 

for each s as defined above. 


(16) 


Note that even though the parameters of the compensator can be found 
more easily using (16) instead of (14) , they are not readily available 
and the computations are still difficult especially because of the 
integration that must be done. 


) 
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3. MINIMUM VARIANCE CONTROL — MATRIX APPROACH 

The difficulty of solving this minimum variance control problem 
using the direct method 1 approach, leads us to obtain the solution by 
using state space techniques. The idea behind this matrix approach is 
to convert the system and the assumed compensator structure into state 
space form and then minimise the limit as t <x> of the variance of the 
output with respect to the unknown parameters. 

Recall from the previous section that the plant mathematical representa- 
tion is 

y(t-j-n) -r a _y(t+n-l)-r ... -f a_y(t) - h ,u(t+n-l)-r ... + b u (t) 
n~l o 0 

+ c , (v(tH-n-l)t ... + c_v(t) (1) 

n— ± u 4 

and the compensator’s is 

u(t+n).+a^^u(t+n^l)+ — *r d_u(t) “ 3 : (t-rn-l)-f + 

-r f -V7 T * - * ■ t f Jf/J (t) (2) 

n—l Q 


We can represent these systems in state space form as 



_£* n 
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y(t) = [0 0 ... 0 l]x(t) 


C4) 


z(ttl) = 


0 0 
1 0 
0 1 

0 -d 0 “ 

« » * 0 

o -d 2 

s(t) + 

r o 

f l 

X 2 

y (t) + 

f o 

f i 

*2 

0 0 
« [0 

1 A-1_ 
0 ... 01] 

z(t) 

■F 

~n- 1 


f n-l 


u(t) 


(5) 

( 6 ) 


and for convenience as 

x(t-KL) — Ax(t) + Bu(fc) -5- Cv(t) (7} 

y(t) « BJC(t) (8) 

z(t+l) = D^ Bg z(t) + Fy(t) + Fw(t) (9) 

Ai (t) = Hs(t) (10) 

Furthermore, we assume that (a.,B) and (&.,C) are controllable pairs. 

For reasons that will be seen later, we let 


D 


OBS 


where 


L 


= LtDH 


0 0 

1 0 

0 1 

# p 

* * 


0 0 
0 o 
0 0 


L° 0 i oj 


(11) 


and 


rt. 
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Then we can rewrite (9) as 
z (t-HL) = (L+DH)z(t) -5* Fy(t) + Fw(t) 


and the augmented system is 


'x(t-KL)" 

■ = 

‘a 

BH 


~x(t)‘ 



0 ~ 


”v(t)" 

s (t+l)_ 


FK 

L*f*DH ; 


_z (t). 


_0 

F 


w(t)_ 


y(t) 


[H 


0 ] 


x(t) 

a(t) 


Le‘ 


;ing 


^(t) 


x(t) 
Z (t) 


and 


= 

A BH 

a - 

o 1 

o 

’ 1 


_F L+DH _ 


r o 
1 


we can write (13) and (14) as 


( 12 ) 


(13) 


(14) 


(15) 


( 16 ) 
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?{t+i) = r £<t) + a 


y(t) = [H 0] |(t) 


Note from {17} that 


?(t) = r fc §(o) + l 

i =6 


r t “ i “ 1 a 


We are now ready to find the variance of the output as follows 


E(y'(t)y(t)) = E(g*(t) 


[H 0] £{t)) 


var {y (t) ) = E(g’(t) 


since we are interested in finding the limit as t -h» of var (y (t) ) as a 
function of the initial conditions of the plant and compensator , and the 
disturbance variance, we can rewrite (21) as 


liffl EES’ (0)F* 

tprOO 


,t T h'e o _t 


r 11 £<0) + l [v(i}w(i)] a' F* 
0 1=0 


t-i-1 


H’E 0 


l V 


t-j-1 


which, recalling from the previous section that w(t) and v (t) are 


independent white gaussian noises, becomes. 


-78- 


. H l H 0 t-1 

iim Bis* (o) r* • r 5(0) + i [v(i)w(i)] a ’ r' 

0 0 i=0 


t-i-1 


H'H 0 


0 0 


„t-i-l 


that can be computed as 


v 0 

tr ( A.. H (0) ) + tr (A„ a a' 

x 0 w 


where 


(0) = E[5(0)5’ (0)] 


= lim T* 


t |H'H 0 


t-1 • . _ H’H 0 

„ . t* t-i -1 

11m i r 1 

t-7-CQ i=0 0 0 


„t-i-l 


Since we want a stable overall system, note that lim F should be zero so 

t-Ko 

^ = 0 (27) 


then (24) becomes 


vHr(y(«r)) = tr(A 


CVC 1 0 


0 FWF 


4 > . 


where A^ solves the discrete time Lyapunnov equation. 

H'H 0" 

0 0 _ 


A 2 = T' A 2 A + 


£ 29 ) 


At this point we can see why the compensator is not guaranteed to 
he stable while the overall system is, Prom equation (23 } we note that 
although we are “sort of penalising" x(t) we are not doing the same with 
s (t) , and from (26) we observe that if the overall system was not stable 
would diverge- We are now ready to solve for the necessary conditions 
in order for the compensator to privide a minimum variance control. To 
do this we have to minimise 


tr ( A_ 


CVC* 0 
JD FWF 
with respect to F and D 
subject to 


A 2 = r* A 2 r + 


0 


0 

0 


As was pointed out in chapter three/ we can convert this dynamic 
minimisation problem into a static minimisation as fallows* 
Define 


J = tr (A 

“cvc" 

0 

+■ [*-A +■ r'A. p + 

H'H 

cf 


_0 

FMP'_ 

£* A. 

_0 

0 _ 


(30) 


In order for J to be a minimum the following necessary conditions must 


be satisfied 


where | A means "evaluated at the optimum solutions 


From (31) we obtain 

H'H 0 
0 0 


a 2 = f ii 2 r ♦ 


From (32) 



rar 1 + 


cvc* 0 

0 FWF ' 


Partitioning A_ and £ as 
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we can see that £30) can be rev?ritten as 

j = trtAjjCvc' + A 22 otjp> + E-A^a + a* A, 2 fh + h*f' £ a + 

+ H'F'A^FH + H' H] Bjj * I-A 12 + A'AjjBH + A 1 + A'A^DH + 
+ H'F'Aj^BH + H'F'A 22 L + H'F’A 22 DH] gjj ^ 2 + [-A [ 2 + h'b'A^a + 
+ H'D'A^A + H'B'AjjjPH + l'A ?2 fh + h'd"A 29 fh] 3 i2 + (-ii^ * H 
+ H'B'A 12 L * H'B'A^DH + H'D'Aj^BH + L'AJ^BH + L'A^L + 

+ l’A^dh + H'D'A 22 L + H'D'A 22 DH) 6 22 I 


so r from (33) and (37) 


o = A 22 fw + + A 22 fhb u h' + A^bhS^h' + A 22 i8 i2 H- 


+ A 22 DBB i2 H' 


and from (34) 


0 = Ai 2 AS 12 H' + A 22 PHB 12 H' + Ai 2 BHB 22 H' + + A 22 DHB 22 H' 


Note that 


° = ^12 + + A i2 BH e 2 2 + A 2 2 <t '® E >« 


22 


is sufficient for (39a) to be satisfied 
Solving for F in (38) we get 


’ b,a li bh * 


(37) 


(38) 


(39a) 


(39b) 
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F = -A 


^ / A * 


‘22 <A 12 aS ll H ' + AL-’ 3 ^' + 


and substituting (40) in (39b) 

(L+DH) = A ll ^ M-6 12 + („ + HS 11 H')- 1 B S 12 ] 


[B 22 -B; 2 H ’(w«B u H, )- 1 HBi2r 1 - t£ l ^ 2 BH 


finally 


F = " A 22 A 12 AE6 h H ‘ + + 0 11 H I (W^3 11 H-* ) h3^ 2 ) 

( S 22 - B^h' (wtHS^h ' ) ~ 1 h 0 12 ) _1 B| 2 H' 1 [w-rH3 11 H ' ] “ 1 


Expanding (36) we obtain 


Bu - A ^ 11 a ’ + a ^X2 H> B ' + BHg 12 a ' * + CVC ’ 


$' 12 = FH0 11 a' 4- {L-rDH} $* A' -r FH3 12 H’b' + (li+DH) b' 

12 


3 22 = FK^hV + FHg^tL+DH) 4 + (L+DH) P 1 -r (L-rDH) (L-rDH) 1 -r 


*r FWF 


s = | -8l2 + B u H-rw«B 11 H’] _1 EB 1 2 He 22- e l2 H ' [, ' fli8 ll H ' ] " lHe i2 ) ' 1 


fhen, substituting F and (L4-DH) into (44) and (45) 


D 
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e ; 2 - - A i2 A i2 a(8 ll Hl[ “ +HS ll H,, " lH6 U a ' +Sf>^[,, + H S u H’]- 1 H8i ia ' 


SS i 2 a ' + 6 12 H ' B,) - A 22 A u BBte i 2 a ' - B 22 H ’ B '> 


(46) 


B 22 - k ~22 + 






- SS I 2 a ' + 8 12 H ' B ' )B 12 A 22 + A 22 A i2 BH(B 22 H ' B ’ + ‘V 1 


A _ A“J 

12 22 


(47) 


So 

3 . 


22 


-8' L. A"J 

12 12 22 


(48) 


and since S 22 is symmetric 

B 22 - - A 22 A A B 12 (49 > 

Expanding (35) we get 

A,, *»•&'. A, ,A + a' A,„ ph + h- , ’f 1 A' a + h'f' A„_fh + h'‘H (50) 

A = A r A BH + A' A (L4-DH) 4- H' F r A^ BH + H' F' A (L4-DK) (51) 

A 22 . = H'‘B' A BH + H'b' A (L+DH) 4* (L+DH) + (L-rDH) ' A^BH + 

+ (L4'DH)’A 22 (L-rDH) (52) 
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Substituting (41) and (42) in the above equations 


A 11 ' a '\i a ■" a ' A 12 A 22 A> Ce il H ’ + sS^h'hwbR^hT 1 H 


H [w-pHB^H 1 [HB^ ■ h S 12 S ] a A ^ 2 A 22 A ^ 2 a + 


A“1 It- 


• * H- Ew+ H0 11 H-]- 1 [H3 u +. H3 12 S’-]A' A 12 A- A^ a 
r3 in H' + S3^ 2 h’] [w+h3 11 h , ] _1 h -I- h'h 


. a-i 


(53) 


*12 - a ' [A 11 " k U A 22 A 22 1BH + a ' *12 *22 K .2 M - 


A“1 a ' 


- h' [w+h3 i;l h'] 1 [h 3 jl1 + h3 19 s']a' A 12 A x A ^ 2 as 


3-1 


(54) 


^22 H B ^71 ^12 ^22 ^ 12 ^ BH + S A ^12 ^22 ^12 ^ 


(55) 


So, in order to find the compensator that will provide the minimum 
variance control we need to solve equations (46), (47), (48), (53) , (54) , 
and (55). Note that we can reduce the number of equations that must be 
satisfied by one, if we substitute (48) in the others. Observe also 
that A 22 as well as (w-fH3^H ') have to be nonsingular. Although these 
equations seem to be very complicated, recall that H ana- (LtDH) are very 
simple matrices. Thus a lot of simplification will appear during the 
computations. 

Sven though the above equations are more tractable than the ones 
encountered in the previous section, they do not give us in a simple way 


7 - 
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the parameters of the compensator. For this reason, in the next section 
we will develop a direct method to obtain the compensator for a system 
with perfect measurements, i.e., W = 0, that involves only a simple 
polynomial division. 

4. MINIMUM VARIANCE CONTROL OF AN OUTPUT N0I3E-FREE SYSTEM — DIRECT 
METHOD 2 

The idea behind this method is to put the output of the plant at 
time t*fl as a function of the inputs up to time t, the outputs up to 
time t~l, and the internal noise of times t and t-1. Once this is 
achieved we equate the equations of the input and output to obtain the 
structure of the compensator. The reason we set the output at time ttl 
as a function of the outputs up to time t-1 and not up to time t, is 
because we want the compensator to compute each new input as a function 
of the past measurements available and not to include present information, 
in order to avoid the problems mentioned in the introduction to this 
chapter. 

We again are given a plant of the form 


y(t+n) + a v{t*n~l)-r ... -ba_v(t) = b _ u(t*n-l)-r ... t b u(t) * 
n-_L 0 n— _L u 


c _v(t+n-l)+ ... -f c v(t) (1) 
n-_L * u 


We can compute the transfer function of the system as 




( 2 ) 


where 


A* (2) 

-1 , 

■** X . a _s 
n-l 

+ a o 2 n 

B* (z) 

: . . -1 . 
= b , t b 2 4> 

n-l n-2 

-n+i 

. . . - 4 - b z 
0 

C* (z) 

. “3- . 

— c , + C n Z -r 

n-1 n-2 

, -ntl 

... + c 0 z 


so 


V (t+1) 


B*(z) 

A*(s) 


u(t) 


C* (z ) 
A* (z) 


v(t) 


(3) 


It follows from (2) that we can compute v (t-2) , v (t-3) , . . . from the 
information available at time t. To do this explicitly we rewrite (3) 
using the identity 


- 2 , 


C*(z) = A* (z) F* (z) + a G* (a) 


(4) 


where F* and G* are polynomials of degrees 1 and n-l respectively as 


u{t) +S*(z)v(t) + ggj v{t-2) 


Prom (2) we can see that 


v (t— 2 ) = y(t-l) 


B*(a) 


C* (2) 




u(t-2) 


Sufastitutiong (6) in (5) we obtain 


_ B* (z) G*(z)B*(s)z 

yit+x; - & * (z) “ a* (z)c* (z) 


- 2 . 


u(t) + ImI) y (t - u 


which reduces to- 


y (t+1) = B * jg g* tg I tt(t) + fjgj y(t-l) + F* (z)v(t) 


(5) 


( 6 ) 


t F* (z)v (t) (7) 


( 8 ) 


We are now ready to compute the variance of the output T _±s was pointed 
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out earlier 

E(y 2 (fcfl)) « E[(P*(z)v(t)) 2 ] + E[(|Jg-- yft-1) 

(9) 

Observe that the mixed terms will vanish because v(t) and v(t-l) are 
independent of y (t-1) , y (t-2) , — . Therefore the second term in (9) will 
only increase the variance of y (t-fi) , hence 

( 10 ) 


E (y 2 (t+l) ) > (f 2 + f 2 )V 


where equality holds for 
G*(z) 


u (t) = - 


3* (z)F* (z) 


v(t-l) 


( 11 ) 


So, the transfer function of the minimum variance compensator is 
given by 


U(t) = - 


-1 , , -n-tt 

+ ---+V 

(b n-l * V2 Z_1 + + b 0 3 “ n+1) (f l * f 0 Z " 1) 


y(t-i) 


( 12 ) 


Mote that if either b , or f , , or for the same purpose b . or c . 

n— 1 1 n-i n— i. 

is equal to zero, the structure of the compensator found this way will 
not be desirable since u(t) would depend on y(t). If this was the case, 
it is obvious that following the same procedure outlined, above we can 
obtain a compensator that will satisfy the desired structure. 

As was mentioned before, note that the parameters of the compensator 
are obtained basically from the polynomial divisoa in (4). So this 
technique presents a very simple way of finding the minimum, variance 


n 


compensator. The only drawback of this method is that the measurements 
are assumed to be perfect, i.e., no noise affects the sensors. This 
assumption is highly idealized, since every sensor has at least Home 
internal noise generated, that will influence the accuracy of the 
measurements. But if this perturbation is small, the solution obtained 
in (12) is very accurate. 


-89- 


' CHAPTER V 
EXAMPLE 

In this chapter we solve a simple problem using the direct method 2 
and then we corrolate the answer by showing that it satisfies the 
necessary conditions found for the matrix approach* 

1. DIRECT METHOD 2 

Let us assume that we have a second order plant governed by 

yCt-rZ) - y(t? = u(t*rl) + 2u(t) t 2v(t-KL) (1) 

chen the. transfer function of the system is 

y(t) = — 7 • U(t-l) -r — — r 2 (2) 

1 - z 1 - z 

Since 

2 = 2(l-s~ 2 ) + 2z" 2 (3) 

We find that the compensator is given by 

u(t) = • y(fc-l) (4) 

(l+2z~ x ) (2) 

So 

u(t+2) + 2 u(t-KL) = - y (iri-1) (5) 

and the output variance is given by V 

E(y 2 (t)) = 4V 

2. MATRIX APPROACH 

From Cl) and (5) we find that 
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"0 1 ' 

- 1 °. 


B = 


(XrrDH) = 


“0 0 
1 -2 


and we want to show that D and F as given above satisfy the necessary 
conditions obtained in section three of the previous chapter* To do this 
we show that there is a A^, A.^, & 22 , S^, and $ 22 that will give 

us the above values for F and D. 

Note that the pairs {A, 33} and (A,c) are controllable. Let 


A 11 = 


A lll A 112 


A 112 A 113 


A 12 = 


A 121 ^22 


A 12 = 


A 221 A 222 


A 222 A 223J 


s u- 


S lll ^112 


0 112 ^113 


^121 ^122 ^221 ^222 

P 12 = $22 = 

^123 ^124 ®222 S 223 


Proa 


= a'A^a + a'A 12 ph + h'fA^a + h i p’A 29 fh + h'h 


we get. that 


A lll A 113 


A 223 2A 122" 1 


0 
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Prom 


A 


12 


A'i^BH + A' A 12 (L-rDH) + H'P'A^BK + H'p' A^ (L*DH) 


we obtain 


A 121 - 0 


A 122 4 ~ 3A 111 A 112 2 2 A 1 . 


11 


A 123 = - 5 ' 3A 111 A 223 = 7 “ 6A 111 


and from 
A. = 


• 22 = H B A^BH -r BE + H , B , A 12 (L+DH) -t (L+DH) 'A^BH + 


+ (L+DH) 'l \ 22 (L+DH) 


we get 

A 221 ” 7-6A m A 222 = “ 6+6A m andA lll = 1 


Then 


11 


" 1 

0 


"x 

0 


1 

0 

0 

-t 

1 _ 

11 

CM 

-2 

0 

A 22 

0 

1 


From 


ft 


ii 

we obtain 


a6 li a ' + aS 12 H ' B ' + “^2*-' - ^2 V*'®’ + CTC ’ 


^124 ° ^122 6 113 “ ^111 "* 4V ^122 




. ■ r 
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From 


\ 2 = a3 21 h.V + ae i2 (L+DH) + BH6^ 2 h'f’ - BH A ?2 A^ A^CL+DH) 


we get 


^121 ° ^123 0 ^124 ° ^112 " ° 


^113 4V ^111 3 ^ 


and from 


22 


— T 

- A " A’ 

22 12 h 12 


we get 


^221 ° 


222 


° ^223 f 7 


£hen 


11 


A 

- f 7 0 


4V 


12 


A 

o fr 


0 0 


J 22 


0 0 


o -fv 


Substituting these results in 

V 6 11 «■ + V Hf5 U Hi + V H B i 2 B ' + A 22 (IrfBH)B i2 H ' 


and 


A i 2 iS 12 + + A 12 BHB 22 


+ A 22 (ih-dh) B 22 


we see that both become equal to zero, which was the result we expected. 
We then conclude that the compensator described by the above F and D 
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gives a minimum variance control strategy. 

2 

Note that E (y (t) ) is given in uhis case by 

E(y 2 (t)) = tr (A i;l cvc ' ) = 4V 

which is the same result obtained with the direct method 1. 

REMARKS: 

In chapter four we discussed three different methods to obtain a 
compensator that would minimise the variance of the output of a discrete 
time linear time invariant single input single output system- As was 
seen in the second section further study in this problem is required to 
be able to find the desired compensator using the direct method 1. Also, 
from section three r more insight into this kind of problems will prove 
to be of great help in order to find the compensator structure. Maybe,., 
some easier equations would develop if the compensator is found in two 
steps a) a form of observer plus b) a matrix of gains.* Some analysis 
to establish if the necessary conditions found with this matrix approach 
give a unique solution or if a stable compensator can always be found 
would be a very interesting topic to work on. Some other lines of 
study around this problem could be to generalize the three methods to 
the multiple input-multiple output case. It would be also very interest- 
ing to find if the insertion of noise in the measurements r working with 
the direct method 2 r gives any results. 
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